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Abstract 

We study a one-dimensional random walk whose expected drift 
depends both on time and the position of a particle. We establish 
a non-trivial phase transition for the recurrence vs. transience of the 
walk, and show some interesting applications to Friedman's urn, as 
well as showing the connection with Lamperti's walk with asymptot- 
ically zero drift. 

Keywords: random walks, urn models, martingales. 
Subject classification: primary 60G20; secondary 60K35. 

1 Introduction 

Consider the following stochastic processes Xt which may loosely be described 
as a random walk on M_|_ (or in more generality on M) with the asymptotic 
drift given by 
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where p, a and (3 are some fixed constants, and the exact meaning of "~" 
will be made precise later. In this paper we establish when this process is 
recurrent or transient, by finding the whole line of phase transitions in terms 
of {a, (3). We also analyze some critical cases, when the value of p becomes 
important as well. Note that because of symmetry, it is sufficient to consider 
only these processes on R_|_, and from now on we will assume that > 
a.s. for all values of t. 

The original motivation of this paper is based on an open problem related 
to Friedman urns, posed in Freedman [3]. In certain regimes of these urns, to 
the best of our knowledge, it is still unknown whether the number of balls of 
different colors can overtake each other infinitely many times with a positive 
probability. We will not describe this problem in more details here, rather 
we refer the reader directly to Section [HI 

Incidentally, the class of stochastic processes we are considering covers 
simultaneously not only the Friedman urn, but also the walk with an asymp- 
totically zero drift, first probably studied by Lamperti, see [7] and [8]. His 
one-dimensional walks with drift depending only on the position of the par- 
ticle naturally arise when proving recurrence of the simple random walk on 

and and transience on Z'^, c? > 3. They can be used of course for an- 
swering the question of recurrence for a much wider class of models, notably 
those involving polling systems, for example, see pQ and [H]. It will be not 
surprising if the model we are considering also covers some other probabilistic 
models, of which we are unaware at the moment. 

In our paper we study the random walk whose drift depends both on time 
and the position of a particle. Throughout the paper we assume that 

{a,f3) eT = {{a,f3) : (3 > a and (3 > 0} 

to avoid the situations when the drift becomes unbounded and the borderline 
cases (the only exception will be a = /? = 1). We will show that under some 
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Figure 1: Diagram for {a, (3). 



regularity conditions, the walk is transient when {a,f3) lie in the following 

area 

Trans = {{a,p): < /5 < 1, 2/5 - 1 < a< /5} C T 
and recurrent for {a, (3) in 

Rec = T\ Trans = {{a,p) : /3 > 0, a < min(/3, 2/3 - 1)} 

where Trans denotes the closure of the set Trans. In the special critical 
case a = (3 = 1 we show that the walk is transient for p > 1/2 and recurrent 
for p < 1/2. An example of such a walk with a = j3 = 1 is the process on 
Z+ with the following jump distribution: 



This walk is analyzed in Section [61 

Throughout the paper we will need the following hypothesis. Let Xt 
be a stochastic process on with jumps Df = Xt — and let J-'t = 
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cr(Xo, Xi, . . . , Xf). Let a be some positive constant. 

(HI) Uniform boundedness of jumps. 
There is a constant i?i > such that \Dt\ < Bi for all t G M+ a.s. 

(H2) Uniform non-degeneracy on [a, oo). 
There is a constant i?2 > such that whenever Xt-i > a, E [D^ \ J^t-i) ^ B2 
for all t G M+. a.s. 

(H3) Uniform boundedness of time to leave [0,a]. 
The number of steps required for Xt to exit the interval [0, a] starting from 
any point inside this interval is uniformly stochastically bounded above by 
some independent random variable W >0 with a finite mean ^ = W.W < 00, 
i.e., for all s G M+, when Xs < a, 

Vx > ¥{r]{s) >x\J^s)< ^{W > x), where r/(s) = mi{t > s : Xt> a}. 



The rest of the paper is organized as follows. In Section [2] we prove some 
technical lemmas. In Section [3] we formulate the exact statement about the 
transience of the process Xt and prove it while in Section |4] we do the same 
for recurrence. We also study some borderline cases in Section [5], and present 
an open problem in Section 15. 3[ Finally, we apply our results to generalized 
Polya and Friedman urns in Section O 

2 Technical facts 

First, we will need the following important claim about the law of iterated 
logarithms for martingales. 
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Lemma 1 (Proposition (2.7) in Preedman (1975)) Suppose that Sn is 
a martingale adapted to filtration Tn d'nd A„ = Sn — Sn-i are its differences. 
Let Tn = Yyi=i ^ {^i I = inf{n : T„ > 6}, and 

L(6)=esssup sup |A„(ci;)|. 

Suppose L(h) = 0(6/ log log 6)^/^ as h ^ 00. Then 

limsup = = 1 a.s. on {T„ ^ 00}. 

n^oo V2-/nl0gl0gT„ 

Lemma 2 Let Xf, t = 1,2, . . . be a sequence of random variables adapted 
to filtration Tt with differences Dt = Xt — Xt-i satisfying (HI), (H2), and 
(H3) for some a > 0. Suppose that on the event {Xt > a} 



Then for any A > 



E(A+i|-^t) >0 a.s. 



P(3t : Xt > AVt) = 1. 



Note that in Lemma [2] we prove a weaker result than in the original Lemma [H 
This result, one hand hand, will suffice for our purposes, while on the other 
hand it does not require a sequence Xt to be an exact martingale, rather 
than just a submartingale, and only on [a, 00). 

Proof. First, we are going essentially to "freeze" the process Xt whenever 
it enters the interval [0, a], where it is not a submartingale, until the moment 
when Xt exits from this interval. Define the function s{t) : — > Z_|_ such 
that s(0) = and for t > 



s{t+l) 



t + 1, if Xt > a or Xt+i > a 
s(t), otherwise. 



Let Xt = Xs(^t)- Then X„ is a submartingale satisfying (HI), perhaps with a 
new constant Bi = Bi + a. Indeed, when Xt > a, Xt = Xt and X^+i = X^+i, 
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so E{Xt+i - Xt\J^t) = > 0. When Xt < a (and so is Xt < a), 

either Xf^i < a and then s{t + 1) = s{t) implying Xf+i — ^t, or ^t+i ^ « 
in which case Xf+i — Xf+i > a > Xf 
Let 

Dji — Xn — Xn-l 

Z„ = E (L>„ I J^„_i) > 

Sn = — Z\ — Z-2 — ■ ■ ■ — Zn- 

Then 

E ((S'n — (S'n-i I J-n-\) — E (X„ — X^-X — Z^ \ Tn-\) — 

whence 5'^ is a martingale with differences A„ := Sn — Sn-\ = Dn — Zn- Note 
that 

E (A^ I J^^_,) = E {{Sn - Sn-i - Zn_,f I = E (£>^ I Tn-i) - Zl (1) 

Let 770 = and for A; = 1, 2, . . . 

Ck = inf{t > r]k-i : Xt < a}, 
rjk = inf{i > : Xt > a} 

be the consecutive times of entry in and exit from [0, a]. Then Wk := % — Cfc 
are stochastically bounded by i.i.d. random variables Wi,W2, ■ ■ ■ with the 
distribution of W. Therefore 

limsup — — < /i a.s. 

and consequently the number 

In = {t e {0,1, . . . ,n- 1} : t ^ [Cfe, 77fe) for some k} 
= Oe{0,l,...,n-l}:Xt>a} 
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of those times which do not belong to some "frozen" interval [Ca;,^) satisfies 
a.s. 



(2) 



for n sufficiently large. 

Next, since -D„'s are bounded, we have |A„| < |D„,| + |E(D„ | jF„_i)| < 
2{Bi + a). Therefore, L{b) < 2{Bi + a) and the conditions of Lemma [1] are 
met. First, suppose that 

n 



i=l 



then 



lim sup 



V2T„log logT„ 
Therefore, for infinitely many n's we would have 

Sn > A/T„loglog 

Using ([T]), this results in 



1 a.s. 



Xn — Zi + Sn > Zi + 



i=l 



i=l 



^(E(£)2| J-,_i)-Z2)loglogT„ 

\ ^=1 



(3) 



since i — 1 G /„ implies Xj_i > a and consequently Di = Di (note that 
each term in the sums above is non- negative). Let < < be the 
number of those Zj's, i G /„ such that Zi < B2/2. Then ([3]) together with 
E {Df I > B2 yields 



X. > (141 - ^) + ^^i^^™^ > J^^^^™^ 



for n large enough, taking into account the fact that T„ < Bin and inequal- 
ity ([2]). This implies the statement of Lemma [H since we assumed T„ oo. 

On the other hand, on the complementary event Xli^i ^ i^l I ^i-i) < oo, 
by e.g. Theorem in Chapter 12 in Williams (1991) Sn converges a.s. to a 
finite quantity Soo, and we obviously must also have E (£)^ | Tn-i) ~ ^ 
yielding 

liminf Zi > \f^2- 

i— >oo, i: Xi_i>a 

Combining this with ([2]), we obtain 

hm mt — = hm mt > 

n^oo n n^QO n 2/i 

which is even a stronger statement than we need to prove. ■ 

Lemma 3 Fix a>0,c>0,7G(0,l), and consider a Markov process Xt, 
t = 0, 1, 2, . . . on with jumps Dt = Xt — Xf-i, for which the hypotheses 
(HI) and (H2) hold. Suppose that for some large n > the process starts at 
Xq G (a,7n], and that on the event {a < Xt < n} 

E(Al-^t-i) < -. 

n 

Let 

T = mi{t : Xt < a or Xt > n}. 
be the time to exit [a,n]. Then 
(i) T < oo a.s.; 

(a) f{Xr < a) > u = 1/(7, c, B2) > uniformly in n. 

Proof. First, let us show that the process Xt must exit [a,n] in a finite time. 
Since \Dt\ < Bi, by Markov inequality for non- negative random variables for 
any e > we have 

- > (1 - e^)Bl I :Ft-r) < ^^^i'^l'^T"^^ < (1 " 

[l-e )B^ 
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Hence for a sufficiently small e > the RHS of 
1, whence there is a 5 > such that 



can be made smaller than 



P(A'>(£5i)'l^t-i)>25. 

In turn, this implies that at least one of the probabilities P(-Df > eBi \ Tt-i) 
or P(-Dt < —eBi \ J-'t-i) is larger than 6. Hence from any starting point the 
walk can exit [a, n] in at most n/{eBi) steps with probability at least ^"/(^'^i), 
yielding that sBir/n is stochastically bounded by a geometric random vari- 
able with parameter ^"/(^^i)^ which is not only finite but also has all finite 
moments. 

To prove the second claim of the lemma, ffist we establish the following 
elementary inequality. Fix a. k > 1 and consider the function g{x) = (1 — 
x)^ - 1 + kx - k{k - l)xV4. Since ^(0) = 0, ^'(0) = 0, and g"{x) = 
k{k - 1)((1 - xf-^ - 1/2) > for \x\ < l/{2k), we have g{x) > on this 
interval. Consequently, 
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1 -a; r - 1 > 



k{k-l)x\ 
-kx H : for x G 



2k' 2k 



(5) 



Now let Zt = 2n—Xt and Yt = Z^ for some A; > 1 to be chosen later. Suppose 
that n > 2kBi. Then, on the event {Xt G [a, n]} we have Zt G [n, 2n] yielding 
\Dt+i/Zt\ < Bi/n < l/{2k) and thus by ([5]) we have 

k 



i+l 



Yt I ^t' 




c ^ {k-l)B2 



> kY 



-— + 



16n^ 



nZt AZf 
once A; > 1 + 16c/i?2- 

Hence Yt;^r is a non-negative submartingale. By the optional stopping 
theorem, 

E(n)>ro>[(2-7)r^]'. 



> 0, 
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On the other hand, 

E{Yr) =E{Yr; Xr < a)+E{Yr; > n) < (2n)'=P(X^ < a)+n\l-F{Xr < a)), 
yielding 

nx, <a)> ^ ^J^^ =: 1/ > 0. 



Lemma 4 Suppose that Xf, t — 0,1, . . . is a submartingale satisfying (HI). 
Then for any x > 

AhBf 



P ( inf Xt<Xo- bx] < c(h, b, BA 
yo<t</is2 J 



62 ■ 

Proof. Let Z„ = E {X^+i - X^ \ > 0. Then 

St = Xo-{Xt-Zi-Z2 Zt) = {Xo-Xt)+Z, + --- + Zt>Xo~Xt 

is a square- integrable martingale with 5*0 = 0, since l^^l < |-^o| + 2ni?i. 
Moreover, since 

E{{St-St-,f\J^t-i) = E{{Xt-Xt^,-Ztf\J^t-i) 

= E {{Xt - Xt-if I J^t-i) - Zl < El 

we have 

n 

A„ := ^ E {{St - St-,f I ^t-i) < nBl 
t=i 

By Doob's maximum L^ inequality (see Durrett, pp. 254-255), 
E ( sup ISmH <mSl^ ^A^ < AnBl. 

\0<m<n / 

Consequently, by Chebyshev's inequality 



inf Xt<XQ-bx] = P sup Xo-Xt> bx 
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3 Transience 



Theorem 1 Consider a Markov process Xt, t = 0,1,2, .. . on M+ with in- 
crements Dt = Xt — Xi_i which satisfies (HI), (H2), and (H3) for some 
a > 0. Suppose that for t sufficiently large on the event {Xf > a} we have 
either 



(i) for some p > 1/2 



E(A+i|^t) > 



pXt 
t ' 



or 



(a) for some p> and {ol,(5) G Trans 



E ( A+i I Tt) > 



Then Xt is transient in the sense that for any starting point Xq = x we have 

P(lim Xt^oo)^ 1. 

t— >oo 



Proof. Consider Yt = t/X^ Then 
t + 1 t 



t+i ~ 



Y = 



t + 1 



(X, + A+i)2 X? XI 



[I + Dt+^/Xtf 1 + 1/i 



< 



t+1 



t Xt Xf X, 



yielding 

1 + l/t 

Q 

where 



W.{Yt+,-Yt\Tt) < —iT^Qt (6) 



Qt = \- 2p44 + 3i?i'4 + O(Xr^). 



x/-" 'Xt 



Consider two cases: 
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(i) a = (3 = I, then Qt = l-2p + SBf^ + O(Xr^); 



(ii) (a,/?) G Trans. 

In the first case, Qt and hence ([6]) are negative as long as Yt = t/X"^ < r 
for some positive constant r < (2p — l)/3Bf. (Note that this would imply 
Xt > \/t/r > a for large enough t). Fix an arbitrary small £ > and suppose 
that for some time s we have Yg = s/X"^ < sr. Let 



Then Yt/sr is a non-negative supermartingale, hence it a.s. converges to some 
random limit Yoo = linit^oo ^t- By Fatou lemma, EYqo ^Yg < sr. On the 
other hand. 



hence P(r < oo) < e. 

Finally, to show that for any e > with probability 1 there is an s such 
that s/ X"^ < er we apply Lemma[21 Consequently, P(r(s) = oo for some s) = 
1 yielding limsup^^^t/X"^ < r a.s., and thus f^Xt — > oo) = 1. 

Now consider case (ii) and observe that < /5 < 1 and 1 — a > 0. Suppose 
that 



r = r(s) 



inf{t > s : Yt> r}. 



EY^ = E(Y^- r<oo) + E(roo; r = oo) > rP(r < oo) 




Then 




Since t < X^, and 2f3 < a + 1, 




X, 



X, 



l+a-2/3 



1 



0(1), 
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therefore 

V2{l-I3){l-S) 

Qit) < 1 - 2p (1 - 0(1)) + O(Xr^) = 1 - 2^X^(i-/3)(^-^)-(^-")(l - o(l)) < 

since 2(1 — /5)(1 — 5) — (1 — a) > due to the choice of 5. Therefore, on the 
event {X^-^^ <t<X'^},Yt is a supermartingale by inequahty 
Define the following areas: 

M = {s,x>0 
R = {s,x>0 
L = {s,x>0 

By Lemma [21 there will be infinitely many times s for which s < X]/2, so 
that (s, Xs) ^ L. Fix such an s and let 

r = t{s) = inf {t > s : {t,Xt) E LU M}. 

Then := Yt^r(s) is a bounded supermartingale which a.s. converges to 
Y^^; we have Eyci*"* < 1/2 and as before obtain that on the event {r < oo}, 
F(Yr E L) < 1/2 independently of s. Therefore, either r(s) = oo for some s 
which implies transience immediately, or by Borel-Cantelli lemma there will 
be infinitely many times s for which (s, Xg) G M. From now assume that 
the latter is the case. 

Consider the sequence of stopping times when {t,Xt) crosses the curve 
if: = Xf'^, then reaches either area L or area R before crossing this curve 
again. Rigorously, suppose that for some t = ctq we have (t, Xf) G M and it 
has just entered area M. Set 

?7o = inf {t > (To : (t, G L U R}. 

Then for k > let 

\ inf{t > 7]k : (t, Yt) G M}, if (r/^, X^ J G L 
\ inf {t > riu : (t, Yt) i M}, if (r/,, X,J G i?. 
r/fc+i = inf {t > (Tfe+i : (t, Fj) G L U i?}. 



13 



Thus we have 

(To < ^0 < CTl < ^1 < 0^2 < ^72 • • • 

Of course, it could happen that one of these stopping times is infinity and 
hence all the remaining ones equal infinity as well; however this would imply 
that {t, Xt) ^ L for all large t, which in turn implies transience (recall that 
we have assumed that we visit the area M infinitely often). Therefore, let us 
assume from now on that all r^^'s and a^'s are finite. 

For t > ak, k > 0, consider a supermartingale Y^'^'^ = Yt/^^ik- Since 
the jumps of Xt are bounded, X^^ = al^^^~^^ + 0(1) and EY^^ < Y,^ = 
X~^{1 + o(l)) and as before, we obtain that 



P((r^„X,J G L I J-.,) < X-/(l + 0(1)) = (7) 

On the other hand, starting at (crfc,Xo-j.) it takes a lot of time for (t, X^) to 
reach L, and also if {rik,Xrj^) G -R it takes a lot of time to exit M, since the 
walk has to go against the drift. More precisely, 

o-fc+i - o-fc > (r/fe - crfe)l(^^ V )eL + (o-fc+i - Vk)'^{vk,x^,)eR- (8) 



Set X : — Xa-f, , 



1 1 

< 



2(25i + l)2 8^2' 
and observe that since 2hx'^ — x^~^ > hx^ 



inf X^^+i > xV2h \C{{ak + i, X,,+i) ^ L for all < i < hx'}. (9) 

0<i<hx^ J 

By Lemma HI the probability of the LHS of ([9]) is larger than 

2-S 

Similarly, when (r7fc,X^^.) G i? set ?/ := > x^-^K Since 

{y - xf-^ - x^-^ > x^-^{l + o(l)) - x'^-^ = x^+^(l + o(l)) > x'^ 
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we have 



inf X^^+i >y-x\(Zl{'q^ + ^.X^^+i) g M for all < « < — ^ ^ .(10) 

0<i<x2/(8Bf ) J [ O-Di J 

By Lemma m the probability of the LHS of ffTOl) is also less than 1/2. There- 
fore, since a < l/(8i?^), from ([8]) we obtain 

On the other hand, provided cxfc is large enough, 

aXl^ =acr|^(l+o(l)) >3crfc 
yielding that for large k for some Ci > 

Consequently, the probability in ([7]) is bounded by 

1 + 0(1) 



(Ci2* 

which is summable over k. By the Borel-Cantelli lemma only finitely many 
events {(r/fc,^^;,) G L} occur, or, equivalently, for large times (t,Xt) ^ L. 
This yields transience. ■ 



4 Recurrence 

Theorem 2 Consider a Markov process Xf, t = 0, 1, 2, . . . on ]R_|_ with in- 
crements Dt = Xt — Xt-i, satisfying (HI) and (H2) for some a > 0. Suppose 
that on the event {Xt > a} either 

(i) for some p < 1/2 

E(A+i|^0<^> 

or 
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(ii) for some p > and {a, (5) e Rec 

E(A+i|^t) < 



Then Xt is "recurrent" in the sense that for any starting point Xq — x we 
have 

¥{3t>0 such that Xt < a) ^ 1. 
Hence also P(Xt < a infinitely often) = 1. 

Proof. Consider Yt — Xf/t > and assume Xt > a. Then 

{Xt + Dt+^r Xi _ 2tXtDt+i - X^ + tPl, 

whence 

{t+l)E{Yt+i-Yt\J^t) = E(A+il^t) + [2X<E(A+i|^t)-X2/t] 

< Bf + {2pKt - 1) X^/t < Bl - (1 - 2pKt) Xl^) 

where 

_ xr' 

Consider the following three cases: 

(i) a = (3 = 1, then Ht = 1; 

(ii-a) /3 > a > 1, then since Xt < Bit, Kt < B^/t^-'^ ^ as t ^ oo; 

(ii-b) a < 1, (3 > {a + l)/2, then whenever Yt = Xf/t > r for some fixed 
positive constant r we have 

I ^(a-l)/2 ^{q-1)/2 

f^t = ^l-a^^_i ^ ^(l-a)/2^/3-l = ^/3-(a+l)/2 ^ aS t ^ OO. 
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(Note that (ii-a) and (ii-b) together cover the set Rec.) Set r = 5^/(1— 2p) > 
in the first case, and set r = 2Bf otherwise. Then for t sufficiently large 
from ffTTl) we have 



Let s > 0, and set r(s) = inf{t > s : Yt < r}. Equation f|T2|) yields that 
YtAris) is a supermartingale, therefore a.s. there is a hmit Fqo = linit^oo ^tAr(s)- 
This implies that either r(s) < oo for infinitely many s G or that there 
is a (random) S such that t{S) = oo. In both cases we conclude that there 
is a possibly random value Z such that Xf < Zt for infinitely many times 



First, suppose that a > 0. Then for a fixed define a process Xj. = Xt+tu- 
Set n = 2Xt^ and 7 = 1/2, and observe that the process X[ satisfies the 
conditions of Lemma [3] with some c = c{2(3 — a,p,Z) > 0. Indeed, when 
Xt < n, the drift of Xf is at most of order n°'/t^ ~ l/n^'^"" < 1/n since 
2/3 — a > 1 and a > 0. Hence, there is a constant z/ > 0, independent of t^, 
such that 



Therefore, by the second Borel-Cantelli Lemma (Durrett, p. 240) {Xt < a} 
for infinitely many t's. 

Now suppose that a < 0. Consider Wt = X^'" for some < < 1. Then 



E{Yt+,-Yt\J=-t) < 0. 



(12) 



4eZ+, A; = l,2,.... 



^{^t, t > tk, reaches [0, a] before [n, 00) | J^t^) ^ ^- 



E{Wt+,-Wt\J^t) 



= Xl-'E ((1 + A+i/Xi) 



- 1 1 ^0 



= {1 - u)Xl-^E 

< (1 - .jAT'- (^i^ 
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Let n = Uk = VZtk, so that Xt^ < n. Since 2/3 > 1 + a, we can fix an > 1 
such that 

2(3 > C(l + a). 
Consider the process Wt for t E [t^., rj] where 



:= inf{t > 4 : Xt<aoiXt> rf}. 



Then rj < oo a.s. from the same argument as in part (i) of Lemma [3l 
Moreover, for t G [tk, rj] 

1^ - WJW ~ n2/3-C(i+a) as A; ^ oo. 

since tk ^ oo and hence Uk ^ oo. Therefore the RHS of (fT3|) is negative 
and thus WtAri is a supermartingale. Consequently, by the optional stopping 
theorem 

n'-" > X\;^ = 1^,, > E {Wr, I J > (1 - V^n^f-"" 
where p = Pk = IP(-^r? < « I -^tfc)- This implies 

Pk>l (c-i)(i-,^) ^ 1 as ^ oo. 



finishing the proof of the theorem. 



5 Special cases 
5.1 Case a = P>0 

Since we can always rescale the process Xt by a positive constant, in this 
section we assume that Bi = 1. Then, in turn, it is also reasonable to 
restrict our attention only to the case p < 1, since if the jumps of Xt can be 
indeed close to 1 with a positive probability, we might have X ^ t, and the 
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drift of order p{X/t)^ with p > 1 would imply that the drift is in fact larger 
than 1 = Bi leading to a contradiction, so the model would not be properly 
defined. 



Theorem 3 (a = /5 < 1) Consider a Markov process Xt, t = 0, 1, 2, . . . on 

]R_i_ with increments Dt = Xf — Xt-i, satisfying (HI), (H2), and (H3) for 
some a > 0. Suppose that for some f3 < 1 and p G (0, 1] on the event 
{Xt > a} 



E(A+i|^i)>p(^^ 
Then Xt is transient. 

Proof. The proof is identical to the proof of Theorem [H case (ii). ■ 

Theorem 4 {a = f3 > 1) Consider a Markov process Xt, t = 0,1,2, .. . on 
with increments Dt = Xt — Xt-i, satisfying (HI) and (H2) for some 
a > 0. Suppose that for some 13 > 1 and p < 1 on the event {Xt > a} the 
process Xt satisfies 

fX^^ 
E(A+i|^i)<pf^ 

Then Xt is recurrent. 

Proof. Fix G (p, 1) and consider Yt = Xt/f^. Then, calculating as before, 
we obtain 

E (r.+i - Yt I :Ft) < ^^^^ {piXt/tr-' - C) . 

Since limsupX^/t < Bi = 1 and p < (, for large t this is negative and hence 
1^ is a non-negative super martingale converging almost sure. On the other 
hand, C < 1; thus implying 

lim — - = lim — = a.s. 
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„ , „ I „ ^ / Xf \ Xf 1 Xf 



and consequently since (3 > 1 for some sufficiently large t we have {Xt/t)^ ^ < 
1/4. Therefore, for large t, 

/3-1 

t J ' t - A t 
and hence is recurrent by Theorem [2l ■ 

The following statement immediately follows from Theorems [T] and [21 

Corollary 1 (a = /5 = 1) Suppose that Xt is a process satisfying (HI), (H2), 
and (H3) for some a > 0. 

(i) If for some p < 1/2 

E ( A+i I J^t) < ^ w'/ien > a 
then Xt is recurrent, 
(a) If for some p > 1/2 

E {Dt+i \Tt)>^ when Xt > a 
then Xt is transient. 

5.2 Case a < 0, (3 = 

In this case, the drift is of order p/Xj/ where u = —a > 0. This is the 
situation resolved by Lamperti [7j and [8]. 

Theorem 5 (a = —1, /3 = 0) Suppose that Xt is a process satisfying (HI) 
and (H2) for some a > 0. Then, when Xt > a, 

(i) if for some p < 1/2 

E ( A+i I J^t) < p ^ 

then Xt is recurrent; 
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(ii) if for some p > 1/2 
then Xf is transient. 



E ( A+i I ^t) 



X, 



Corollairy 2 (a E (—00, —1) U (—1, 0), P — 0) Suppose that Xf is a process 
satisfying (HI) and (H2) for some a > 0. Then, when Xt > a, 



(i) if for some v > \ 

then Xt is recurrent; 

(ii) if for some v <1 

then Xf is transient. 



E(A+i|^t)<^ 



E ( A+i I ^0 > 



5.3 Case 2/3 — a = 1, — 1 < « < 1: open problem 

Two cases a — P — 1 and a — —1, P — are already covered. It is also 
straightforward that when q; = 0, /3 = l/2by the law of iterated logarithm 
the process is recurrent for any p. 

Cases — 1 < a < 0, /9 = i(a + 1) and < a < 1, P — ^{a + 1): unfortu- 
nately, we cannot find a general sensible criteria to separate recurrence and 
transience here, and leave this as an open problem. 



6 Application to urn models 

Fix a constant a > 0. Consider a Friedman-type urn process (Wn, Bn), with 
the following properties. We choose a white ball with probability Wn/ {Wn + 
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Bn) and a black ball with a complementary probability; whenever we draw 
a white (black resp.) ball, we add a random quantity A of white (black 
resp.) balls and a — A black (white resp.) balls; For simplicity, suppose 
< y4 < o" a.s. A special case when A is not random is considered in 
Freedman (1964). Following his notations, let a = E, A, j3 = a — a, and 
p = {a — (3)1 a = {a — (3) / {a + (3). Also assume that a > /3 > 0. 

It turns out that this urn can be coupled with a random walk described 
above. Indeed, for t = 0,1,2,... set Xt = \Wt - Bt\/{(3 - «) G Z+ C 
M+. Without much loss of generality assume that the process starts at time 
{Wo + Bo) /a e Z, then t = {Wt + Bt)/a G Z. 

Consequently, once Xt 0, 

E .0 4 ^) <-h1 0- ^) ^ 

Corollary 3.3 in Friedman (1965), states that when p > 1/2, Wn — B^ = 
Wo — Bo (equivalently, X„ = 0) occurs for finitely many n with a positive 
probability, and after the Corollary Friedman says that he does not know 
whether this event has, in fact, probability 1. On the other hand, our The- 
orem [2] answers this question positively - indeed, a.s. there will be finitely 
many times when the difference between the number of white and black balls 
in the urn equals a particular constant. 

See Janson |6] and Pemantle [10] for more on urn models. 
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